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ABSTRACT 



Provided is an image input apparatus in which changeover 
between sensing and transfer of low-resolution images such 
as moving images. and high-resolution images such as siill j 
images can be performed smoothly during intake sensing 
Jtlri H ? f51 trancfpf T^ratlftHfti Th " apparatus includes an 



image signal generating circuit for sensing the image of a 
subject and generating an image signal indicative thereof; a 
data transfer circuit for transferring the irnafre. signal gp.ne.r- 

jited hy the imap;e signal generating circuit tn an extern al 
device via a prescribed mrnrmini c ations interfac e, the/cfata 

"Transfer means having a first transfer mod e in which there 
can be assured a fixed transfer rate but with no guarantee of 
data, and a second transfer mode in which data is guaranteed 
but transfer rate is not; and a control circuit for controllin g 
the data transfer circuit so as to perform image transfer in the 
first transfer mode in a case where the image signal gener- 
ating circuit generates a low-resolution image signal and in 
the second transfer mode in a case where the image signal 
generating circuit generates a high-resolution image signal. 

4 Claims, 12 Drawing Sheets 
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FIG. 10 



© 



© 


R 


B 


G 



® 



® 

G 



G 


R 


CO 

1 


G 





G 


R 


> 


© 


® 


G 






G 


R 
















G 


R 




© 


© 


B 


G 






R 


: g 

1 


1 
1 

i 


J 



B 



oc 


R 


R 


R 




G 


G 


G 


G 




B 


B 


B 


B 



G 


R 


A B 


G 



RGB MEMORY MAP 2 



RGB MEMORY MAPI 



FOUR FRAMES 
OF DATA FROM CCD 



05/26/2004, EAST Version: 1.4.1 



U.S. Patent Jun. 24, 2003 Sheet 9 of 12 



US 6,583,809 Bl 



F I G- 11 

( START ^ 



START SENSING OF MOVING IMAGE 



INSTRUCT ISOCHRONOUS TRANSFER 
TO HOST PC 



TRANSMIT MOVING IMAGE TO HOST PC 



S4 

HIGH- 

"RESOLUTION STILL-IMAGE MODE" 
DESIGNATED ? 



YES 



START INPUT OF HIGH-RESOLUTION 
STILL IMAGE 



INSTRUCT BULK TRANSFER TO HOST PC 



TRANSMIT HIGH-RESOLUTION STILL 
IMAGE TO HOST PC 



YES. 




S1 

S2 



S3 



S5 
S6 



S7 



05/26/2004, EAST Version: 1.4.1 



U.S. Patent 



Jun. 24, 2003 



Sheet 10 of 12 



US 6,583,809 Bl 



FIG. 12 



( START ) 



S15 



S11 



ISOCHRONOUS TRANSFER 
TO HOST PC IN PROGRESS 



COMPRESS.MULTIPLEX AND 
TRANSFER STILL IMAGE 




EXECUTE INPUT OF STILL IMAGE 



YES 



S16 




INSTRUCT BULK TRANSFER TO HOST PC 



S17 



1 



TRANSMIT HIGH-RESOLUTION 
STILL IMAGE TO HOST PC 




( END ) 



S20 
S21 



INSTRUCT ISOCHRONOUS 
TRANSFER TO HOST PC 



SENSE MOVING IMAGE 



05/26/2004, EAST Version: 1.4.1 



U.S. Patent Jun. 24, 2003 Sheet 11 of 12 US 6,583,809 Bl 




.S. Patent Jun.24,2003 Sheet 12 of 12 US 6,583,809 Bl 




05/26/2004, EAST Version: 1.4.1 



US 6,5* 

1 

IMAGE SENSING AND TRANSFER 
APPARATUS AND METHOD 

BACKGROUND OF THE INVENTION 

This invention relates to an. image input appara tu s , 
system, method and storage medium for inputting high - 
resn^ itiori »™ H Ip w-resomtion images to a personal 
rnmpntpr fnr example, 'me invention turtner relates to an 
image sending/receiving system using a low-resolution/ 
high-resolution image input apparatus. 

FIG. 13 is an external view of a videoconference system 
according to the prior art. The system includes a host 
personal computer 101 having a display 102, arjpLa-ui4eo 
^m^i-fl 1fn jt 103, which is capable - yrf h ^ in n ™ nt rnllfi H b v t hft 
host perso n^] mrrp"' Qr 101 1 fVw ''"p""^ moving images to 
the host personal computer 101. The video camera unit 103 
is mounted on a pan head 110 . An integrated cable 1U4 
connects the host personal computer 101 to the video camera 
unit 103. TJie host personal computer 101 has a keyboard 
105, a mouse (pointing device) 106, a microphone set 107 
and a communications cable 108. 

FIG. 14 is a block diagram showing the flow of various 
signal in the system of FIG. 13. 

Shown in FIG, 14 are the video camera unit 103 and pan 
head 110. An expansion board 111 for the host personal 
computer 101 is connected to a PCI bus of the host personal 
computer 101. 

The video camera , unit 103 comprises, a lens unit 112, a 
lens-unit driver 113, an image sensing device (e.g., a CCD) 
114, a correlated double sampling' circuit 115, an automatic 
gain control circuit 116, an adder 117, a timing generator 
118, a processing circuit [referred to as a VIDS (Vertic al 
Interval Data Signal)! 119 for sending and receiving daia Jo 
a video vertical blanking interval, a microprocessor 120, a 
miOTphnnr H?1 and a microphone amplifier 122. 

The expansion board 111 of the host personal computer 
101 comprises an A/D converter 123, a camera process 
circuit 124, a video process circuit 125, a multiplexer/ 
demultiplexer 126 for multiplexing and demultiplexing data, 
audio and images, a PCI bus controller 127, ^ processing 
circuit (VIDS) 128 for sending and receiving d ata in ayideo 
vertical blanking interval, a synchronizing signal generator 
(SSG) 129, a microprocessor 130, an audio A/D converter 
131, an audio D/A converter 132, and an audio process 
circuit 133. 

A CPU 134 constitutes a host computer system including 
a chip set and a memory, etc., and has a hard disk (HDD) 135 
connected thereto via an IDE interface. Applications for 
image input and videoconferencing have been installed on 
the hard disk 135. A communications board 136 is connected 
to the host computer system. 

The general operation of the system constructed as set 
forth above will now be described. 

First, power is introduced to the host personal computer 
101 and the videoconferencing application is started up. 
When the start of videoconferencing is designated by t^ e 
viHeocnnference application, the CPU (not shown) ol tne 
.liost personal computer 101 sends a prescribed command' to 
the_rnicroprocessor 130 of the expansion board 111 so as to 
f l)rn P n * hp p nwpr su pply of the video camera unit i03 . In 
response to an indication from the microprocessor 130 that 
has received the above-mentioned command in this system, 
the power supply circuit of the expansion board 111 supplies 
power to the video camera unit 103 via the integrated cable 
104. (The power supply circuit and power line are not 
shown.) 



3,809 Bl 

2 

J* 1 * 1 v i to wmm i ini '' irn thi ir mpp1f r. fi with pn w nr 

thenceforth initialized ancj fle^or n^ s_animage sensing oper a- 
tion fry nrnce^pfr %i ™™"™lH frnm the microprocesso r 
13fl of UV. frffpanginn hnarH 11J fry the microprocessQr.HO 
5 of the video camera unit 103 via the VIDS 128, integrated 
cable 104 and VIDS 119. Thr ™ m p n nerits of the_vide o 
fflfflfi-fl unit 103 fl fe controlled hy f»n|n mands from^Tn e 

micropro c essor 120. A command jn re.sp nq sr. tn variou s 
enmmanrif; frnro the expans ion board 1 11 is nutput hy tfot 
microproc frr SRnr 1^0 siipenmpnseH by the adder 117 upon 
the vertical blanking interval of a CCD signal adjusted by 
the correlated double sampling circuit 115 and automatic 
gain control circuit 116 and sent to the expansion board 111 
via the integrated cable 104. A signal indicating the vertical 

is blanking interval is generated by the SSG 129 on the side of 
the expansion board and is received by the VIDS 119 on the 
side of the video camera unit 103. 

The CCD signal resulting from imaging by the video 
camera unit 103 undergoes correlated double sampling and 

20 gain adjustment. The above-mentioned CCD signal is super- 
imposed upon the command by the VIDS 119 in its vertical 
blanking interval and sent to the expansion board 111 via the 
integrated cable 104. The expansion board 111 receives the 
CCD signal and converts the signal to digital data using the 

25 A/D converter 123. 

The image portion of the digital data resulting from the 
conversion is supplied to the camera process circuit 124j_ 
which serves as signal processing means, and the command 
portion from the video camera unit 103 is supplied to the 

3 q microprocessor 130 via the VIDS 128. 

The camera process circuit 124 applies prescribed color 
processing and white -balance adjustment to the image signal 
from the video camera unit 103 in digital fashion and outputs 
Y and U/V signals, which are digital video signals that have 

35 been adjusted to a proper level. The camera process circuit 
124 extracts a sharpness signal necessary to drive the lens 
unit 112 and outputs the sharpness signal to the micropro- 
cessor 130. A signal for driving the lens unit 112 is output 
from the microprocessor 130 to the video camera unit 103 

4 0 via the VIDS 128 and 119. The digital Y, U/V signals are 
supplied to the video process circuit 125, which serves as 
image processing means, for being subjected to image-data 
compression processing and the like for purposes of com- 
munication. Here the communication compression scheme 

45 used is that for compressing moving images in videocon- 
ferencing. The scheme is typified by H261 of ITU-T, by way 
of example. 

Besides being subjected to the above-mentioned compres- 
sion processing, the digital Y, U/V signals are supplied to the 
50 PCI bus controller 127 for transfer to the host computer 
system 134. 

_The input from the microphone 121 of the video camera 
unit 103_ is amplified by the ampiirier izz, aiter wnich tne 
amplified signal is input to the adder 137 of the expansion 

55 board 111 via the integrated cable 104. The input from the 
microphone of the microphone set 107 is amplified by an 
amplifier 138 of the expansion board 111 and then input to 
the adder 137. The adder 137 adds the microphone input 
from the video camera unit 103 and the microphone input 

60 from the microphone set 107 and inputs the sum to the audio 
A/D converter 131. JThe microphone inputs that have be en 
converted to_digjjt.a^ riaja , hv the audio A/D converter 131*"a re 
s uhjecteato prescribed voice-data c ompression processi ng 
>*Y {fa fll'Hin nrpcess circuit m. Mere Tne voice-data com- 

65 pression scheme used is that for compressing voice in 
videoconferencing. The scheme is typified by G728 of 
ITU-T, by way of example. 
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The above-mentioned compressed voice data and com- image). Even if an event such as loss of an image due to a 

pressed image data are multiplexed together with the control data error should occur, therefore, the effect upon the 

command from the microprocessor 130 by means of the moving image is small because the image is refreshed in 

multiplexer/demultiplexer 126. The multiplexing scheme is successive fashion. Accordingly, a drawback is that these 

that typified by H221 of ITU-T. The multiplexed data is 5 systems do not take into account the handling of digital still 

t ransmitted to the communications board of another parly images when they are transferred to the host personal 

via the communications board lift and an , fSDN line by computer 101. 
cont rol execute d bv the CPU of the host commit er system 

■j 3 4 L " ^ SUMMARY OF THE INVENTION 

The compressed multiplexed data received from the ISDN 10 Accordingly, an object of the present invention is to 

line is demultiplexed into an image, voice and a control provide an image input apparatus and system and an image 

signal by the multiplexer/demultiplexer 126. The demulti- sending/receiving system in which settings can be made 

plexed compressed image signal is transmitted to the video with ease and whereby low-resolution jmapes such , as digital 

process circuit 125, decompressed and then transmitted from moving images and high-resolution images such as , still 

the PCI bus controller 127 to the host computer system 134 ^ i mages can be transmitted «n a personal computer and 

via the PCI bus. The demultiplexed compressed voice data videoconferenc ing can be carried out in cooperation with an 

is decompressed by the audio process circuit 133 and then application, 

transmitted to the host computer system 134 via the PCI bus Another" object of the present invention is to provide a 

controller 127 so that audio can be heard from a speaker (not system in which a changeover between the sensing and 

shown) connected to the host computer system 134. The M , ransfcr of low . resolut i O I] T images such as m'o^inT Tmates 

decompressed voice data is also directed through the audio ^d~E la h-res61Ulion images such as 7m imagescarrte 

D/A converter 132 so that it can be heard using a speaker -p er i orme d smoo thly during i mag e sensing and d ata transfer 

(not shown) and the microphone set 107 connected to the operations 

expansion board 111. ^ further object of the present invention is to provide a 

In the system described above, the user starts up the syst6m m whidl fa ti handling that takes into account the 

application that has been .installed 111 the hflfit BSPflPal . real-time nature of videoconferencing can be performed in 

computer 101 and mntrnls lhr» nidm ramrra whereby it is regard to image sens ing and transfer 

possible not on ly In display the user's own im^s locally w l n accordance with the present invention, the foregoing 

the momtqr Ji t2 of the host personal computer 101 bur also objecU are attained b idi an ta j t atus 

to communicate y t deo, aud j p and data via , j fe , ISDN line . which in a &st thereof rises; ; si al 

_DirJiiei^nce the system is capable of data communication, ati means for sensj tne im of a subjec , and 

jUajmabJ c to use the mouse 106 a nd keyboard 105 to ti aD j ^ i Native thereof; data transfer 

rnntrnl nnl^yW , l OPjl l ?m™ mn aiso tne camera on i he means for transferri (he ■ si al rated b the 

flirir, nf the communicafng party by virtue ot the apphcaTIoh ^ ^ ^ generating means l0 an ext6ma] device via a 

so ware. . prescribed communications interface, the data transfer 

In the system according to the prior art set forth above, a m^ans having a first transfer mode in which there can b e 

board including the circuitry up to the camera process circuit assured a fixed transfer rate but with no guarantee of data , 

is inserted into a slot of the host personal computer 101 and ' and a second transfer mnrie in which data is ppjarant ee dJ>Tit 

thus can be received within the main body of the host 4Q transfer rate is not; and control means tor controllmgthe 

personal computer 101. This makes it possible to achieve a data transfer means so as to pertorm image transfer in th e 

reduction in the size of the apparatus. However, a disadvan- first transfer mode in a case wnere the image si gnaTgene r- 

tage is that a special integrated cable must be used. ating means generates a low-resolution image 's^ gn5Hm]f ^ 

Furthermore, the user must perform an operation such as the second transfer mode in a case where the lfnage slg pal 

removing the cover from the main body of the host personal 45 g enerating means generates a high-resolution image slgngl 

computer 101 in order to install the expansion board. Tnis is " In accordance with ihe present invention, the for cing 

a troublesome and time-consuming operation. objccts are attained by providing arj image input a pp aratus 

Accordingly, a user-friendly system for inputting images which, in a second aspect thereof, comprises: image signal 

to the host personal computer 101 has been developed and generating means for sensing the image of a subject and 

utilizes a standard int erface with which the host persona l 50 generating an image signal indicative thereof; data transfer 

computer 101 is equipped. In particular, one product (DVC means f or transferring the image signal generated by the 

300, manufactured by Eastman Kodak, Co.) thaLL s arail a b le { raage s i gna i generating means to an external device via a 

inputs an image to the ho st personal co mputer 101 using a prescribed communications interface, the data transfer 

USB (Universal Serial Busl which is an interface adopte d mea ns having a first transfer mode in which there can be 

in the specifications of PC 97 disc losed in the "PC 97 55 assured a fixed transfer rate but with no guarantee of data, 

Hardware Design duide^L of Microsoft Corporation, and anf j a second transfer mode in which data is guaranteed but 

makes it possible to view an image on tne monitor ot tne nost transfer rate is not; control means for controlling the data 

personal computer 101 merely bv using a driver application transfer means so as to perform image transfer in the first 

rf'fti? 11 * " ] y ir \r HP™ a g r^ 1 -P1irrftiVr transfer mode in a case where the image signal generating 

However, the two systems described above merely trarg- 60 means generates a low-resolution image signal and in the 

mit a digital video signal (moving images) to tneJi cTst second transfer mode in a case where the image signal 

personal computer i In via an interface cable. In a case generating means generates a high -resolution image signal; 

where a still image is to be displayed, the image in a display and sensing means for sensing a high-resolution image input 

memory within the host personal computer 101 is merely instruction from an operator; . wherein in a case where t he 

frozen on the monitor screen. In other words, with th e 65 sensing means senses the high- resolution image input 

si«tp.rns d escribed above, the image input tn me host p er- instruction ^generated during low-resolutmn lmap.e_ dala 

sonal computer 101 is only a digital vidgo_signal (amoving transfer bv the data transter rn eftns m th e flrs( transfer mod e, 
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the control means performs control as to cause the , ima^ e signal is generated at the image signal generating step, and 

gign^i gfi peratinfl means to gen era fa a hijg h-resorution im^g e in a second transfer mode, in which data is guaranteed but 

and performs control so as to change over the transler modg . transfer rate is not, in a case where a high-resolution image 

Further, an image input system according to the present signal is generated at the image signal generating step; and 

invention comprises the image input apparatus and input 5 a changeover step of generating a high-resolution image 
means disposed externally of the image input apparatus for, signal and changing over the transfer mode to the second 

inputting the high-resolution i mage input instqicrinn \n the transfer mode in a case where the operator issues a high- 

uBUgfe input apparatus. resolution image input instruction during low-resolution 

Further, the present invention provides an image sending/ image data transfer in the first transfer mode. 

. lecejYinp mm having , an jmajre input ipnitnliw rfl^He of 10 Furth in accordance with me present invent io n> there is 

mnm m tol a Inw-mmlntinn mm < mi l n hirh-rf soh.im n ided a st medium stori a contro , for 

, magft anH . hnst computer having communication meajis ; ui an . and transferrin g the image to an external 

for commmucatmp flam. wtllBT I infixes »« least image d^a device) which contro , m> m a firs( of (he g 

■hfi twfien the host computer and a remote uppanihW Ihrniiph medi comprises: code of an image signa i generating s , ep 

f» nnmmi'mration line, fa image input apparatus including: 1S of ^ the ; of a subject and erati an ima e 

image signal generating means for sensing the image of a gi , mdicative thereof . aod code of an ima transfer st 

subject and generating an image signal indicative thereof; of transferring me image signal gene rated at the image 

data transfer means for transferring the image signal gener- si j ratin stc t0 ^ extemal devicc via a prescribcd 

ated by the image signal generating means to an external communica ti ODS interface, wherein the image transfer step 

device via a prescribed communications interface the data 20 fonns ^ trjmsfer in a firs , transfer mode> in whkh 

transfer means having a first transfer mode in which there , here can be assured a flxe(J transfer fa , e but with nQ 

can be assured a fixed transfer rate but with no guarantee of guarantee of data> in a cas6 where a i ow . re solution image 

data, and a second transfer mode in which data is guaranteed si ^ ^ ated at me ^ si al generating step( and 

but transfer rate is not; control means for controlling the data in a second transfer mode> in which daU ^ guaranteed bllt 

transfer means so as to perform image transfer in the first 25 transfer ^ fe in a case where a high . resoluUon 

transfer mode in a case where the image signa^ generating si ^ ^ a ted at ^ a c si al generating step, 

means generates a low-resolution image signal and m the ^ , , . , , . , 

second transfer mode in a case where the image signal Further, in accordance w.th the present invention, there is 

generating means generates a high-resolution image signal; ? r0Vlded a 4 nntEF l ir i dium StPIinr a mntml nrnpr fflgjor 

sensing means for sensing a high-resolution image input 30 "ipilltinp an inwpf. and transfrnw Ihf, lmagr . lo ^nextejoal 

instruction from an operator; and discrimination means for dgyjcfi^wh.ch control program in a second aspect of the 

discriminating whether the host computer is communicating stora 6 e medium ' <?npn*« code of animage sign aj_gen- 

with the remote apparatus; wherein in a case where the SI^u P ftln p of sfnsinr th r i m^r nf ^.h j m mjri r rn^ fffig g 

sensing means senses the high-resolution image input - a " ™iff» s 'KMi in^t i ye thereof; code of an mage transfer 

instruction generated during low-resolution image data 35 ^ f t™«^ the i^gp ^ grated at the iiittgj 

transfer by the data transfer means in the first transfer mode, S1 8 nal generating step to the external device via a prescribed 

tU . '1 mannt , _r r . rt1 ^ . „„, 1M t u 0 * , M communications interlace, wherein the image transler step 

the control means performs control so as to cause tne image _ * ■ ~ A * i • i ■ f 

, t t . w •„ performs image transfer in a first transfer mode, in which 

signal generating means to generate a high-resolution image - , 6 , * , - . , — 

a c m ♦ ~i „i ^ ° t u„ t „„rf~ r ™„Jl there can be assured a fixed transfer rate but with no 

and performs control so as to change over the transler mode. . , . - . . 

„ , . , . . . . guarantee of data, in a case where a low-resolution image 

Further, in accordance with the present invention, there is *q . . . . . \ . ^, . . , , . . 

. . . . . . • ... . j signal is generated at uie image signal generating step, ancj 

provided an image input method for inputting an image and . z r j • u- u j T ■ j u * 

f A , P r , , ij • !_• i_ * L j in a second transfer mode, in which data is guaranteed but 

transferring the image to an external device, which method, , . . ^ ,„v.™ ' u;„u ■ 

£ - * . L ^ • -1 transfer rate is not, m a case where a high-resolution image 

in a first aspect thereof, comprises: an image signal gener- . . . j . . . . ° .. . °, 

K. iL . r c f j to signal is generated at the image signal generating step; and 

atmg step of sensing the image of a subject and generating *^ a B cha „ g eover step of generating a high resolution 

an image signal indicative thereof; and an image transfer 45 ■ - • 1 A . • *u * * a * *u 

* % . 4l _ . ' j * *l. * image signal and changing over the transfer mode to the 

step or transiting tne image signa generatea at tne image sec - nd - t - ansfer mode 

in a case where the operator issues a 

signal generating step to the external device via a prescribed ... lt . . . . • . *■ j • 1 

■ • . _r t. • .1- * * c * high-resolution image input instruction during low- 

communications interface, wherein the image transfer step data transfer in the first transfer mode, 

performs image transfer in a first transfer mode, in which ° 

there can be assured a fixed transfer rate but with no so 0ther ob j ects and advanU g es besides lhose discussed 

guarantee of data, in a case where a low-resolution image above shal1 be apparent to those skilled in the art from the 

signal is generated at the image signal generating step, and description of a preferred embodiment of the invention 

in a second transfer mode, in which data is guaranteed but whicn follows - In the description, reference is made to 

transfer rate is not, in a case where a high-resolution image accompanying drawings, which form a part thereof, and 

signal is generated at the image signal generating step. 55 which Uluslrate an exam P le of the invention - Such example, 

Further, in accordance with the present invention, there is h _ ow . ever > I s not exhaustive of the various embodiments of 

provided an image input method for inputting an image and »»» ™fUon, and therefore reference is made to the claims 

transferring the image to an external device, which method, ^ hich fol,ow the description for determining the scope of 

in a second aspect thereof, comprises: an image signal invention. 

generating step of sensing the image of a subject and 60 BRIEF DESCRIPTION OF THE DRAWINGS 
generating an image signal indicative thereof; an image 

transfer step of transferring the image signal generated at the FIG - 1 * an external view showing an image input 

image signal generating step to the external device via a apparatus and system and an image sending/receiving sys- 

prescribed communications interface, wherein the image tem according to an embodiment of the present invention; 

transfer step performs image transfer in a first transfer mode, 65 FIG. 2 is a block diagram showing the flow of signals in 

in which there can be assured a fixed transfer rate but with FIG. 1; 

no guarantee of data, in a case where a low-resolution image FIG. 3 is a diagram showing the topology of a USB; 
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FIG. 4 is a diagram showing the data flow of a USB; 
FIG. 5 is a diagram showing the operation of parallel 
plates; 

FIG. 6 is a diagram useful in describing displacement of 
an optical path by parallel plates; 5 

FIG. 7 is a diagram showing the timing at which a parallel 
plate is driven; 

FIG. 8 is a diagram showing directions in which pixels are 
shifted; 10 

FIG. 9 is a diagram showing a Bayer-type filter array; 

FIG. 10 is a diagram showing synthesis of an image by 
shifting pixels; 

FIG. 11 is a flowchart for describing changeover between 
an image sensing mode and a transfer mode; 

FIG. 12 is a flowchart for describing changeover between 
an image sensing mode and a transfer mode during video- 
conferencing in a second embodiment of the present inven- 

tion ; 20 

FIG. 13 is a diagram showing a system according to the 
prior art; and 

FIG. 14 is a diagram useful in describing the flow of 
signals in the system according to the prior art. 

25 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 



15 



30 



Preferred embodiments of the present invention will now 
be described in detail with reference to the accompanying 
drawings. 

First Embodiment 

FIG. 1 is an external view showing the overall configu- 
ration of a desktop videoconference system according to a 35 
first embodiment of the present invention. 

As shown in FIG. 1, the system includes a visualizer 1, 
which has an illuminating light 2, a document glass 3, a 
control panel 4 for operating the visualizer 1, a freely 
rotatable camera head 5 and a camera head support 6 having 40 
a freely rotatable joint. The visualizer 1 makes it possible to 
^I't^h KpK^ nr| an^ output a moving image and a still imaye 
in response to instructions fro m the co ntrol p anel 4 or hos t 
, personal compu ter, as will be described later. 
^AUSB cable 7 connects the visualizer 1 to a host person al 
computexi i. which has a monitor 9 serving as a display um~U 
li keyboard 10 and a mouse 11. A cable 12 is connected to 
an ISDN line, which is connected to a communications 
board 37 (see FIG. 2}, 

FIG. 2 is an overall block diagram showing the flow of 
various signals in the system of FIG. 1. 

As shown in FIG. 2, the visualizer 1 includes a lens unit 
13 for focusing, a leos-uoit drive circuit 14, a parallel plate 
(P/P in FIG. 2) 15 for shifting pixels by displacing the optic 55 . 
axis of an image in order to sense a high-resolution still 
image, and a parallel-plate drive circuit 16. 

The visualizer 1 further includes an image sensing device 
17 such as a CCD sensor. MOS sensor or image pick-up 
tube, a timing generator (TG in FIG. 2) 18, a synchronizing 60 
signal generator (SSG) 19, a combined correlated double 
sampling circuit and automatic gain control circuit 20, an 
A/D converter 21, a camera process circuit 22, a video 
process circuit 23, a multiplexer/demultiplexer 24 for mul- 
tiplexing and demultiplexing data, ^din and jrnpg ef J a 
memory 25 for capturing a still imafi e and synthesizing a 
high-resolution still ima^e t and a memory controller^ 6 for 



45 



50 



performing memory nflf 1 ™"' ™™^ m ^t in t n ^yn- 

\hn\i* fhn hi rj h r r ripll l liftn g) iH-'™ a i o ;fr The camera process 
circuit 22 and video process circuit 23 execute processing 
similar to that of the prior art described above and need not 
be described again. 

The visualizer 1 further includes a microprocessor for 
controlling the overall visualizer 1, a microphone 28^ a 
speaker 29, amplifiers 30, 31, an A/D converter 32, a D/A 
converter 33, an audio process circuit 34 and a USB con- 
troller- 35. It should be noted that the present lUVMllliod is 
jippKrahlp. orjly f p a USB hut also to a scenario in which 
an IEEE 1394 i* ' " 

The USB-compatible 8 is capable of communicating with 
an external dgvTlCe Via I KVSUirh software (not snown) and 
a USB controller 3 6. Devices such as the keyboard 1U and 
mouse 11 also send data to and receive data from the system 
bus fPCT hu<^ nt the hnst personal comouteTK via the US B 
. controller . A communications board 37 is connected to the 
host computer system, which is composed of a CPU, chip set 
and memory, by the PCI bus. The communications board 37 
is controlled by the CPU (not shown) of the host personal 
computer 8. 

An application for videoconferencing and image input has 
already been installed on a hard disk (HDD in FIG. 2) 38 
connected to the PCI bus via an IDE interface (not shown). 
Further, a graphics card 39 having a display memory is 
connected to the PCI bus and causes a display to be 
presented on the monitor display 9. 

The USB (Universal System Tt"s> win ™w hp- Hr^rrihpH 
in simple terms. T he (JSB is characterized in that it supports 
plug- and -play and makes it possible to add or delete periph- 
erals while the personal computer is running, a maximum of 
127 peripherals such as a display, keyboard and mouse being 
connectable. 

With a USB, basically there is one host and a data transfer 
without the intermediary or the host is not possioie . ine 
topology is of the multistar type, in which a host having a 
route root hub branches via hubs, as shown in FIG. 3. 
Functions (devices) of a maximum of six layers can be 
connected. Owing to such factors as data delay, the distance 
from the host to the fastest function (device) is limited to 30 
m. 

As for transfer speed, the USB is available in a 12-Mbps 
full-speed mode and a 1.5-Mbps low-speed mode, and 
different specifications are available for different AC elec- 
trical characteristics as well. Transfer is performed in a 
half-duplex transfer mode. 

Data transfer is p er formed by time sh aring using frames , 
and a packet serving as an SOF (Start ol Prairie J Is" allachecl 
to the beginning of each frame. 

.There are four USB transfer formats, namely isochronou s 
transfer, interrupt transfer, bulk transfer (asynchrono us 
transfer) and control transfe r. 

I sochronous transfer is a transfer scheme h aving the 
highest priority and bandwidth is assured. However, there is 
no assurance in regard to data error. 

Interrupt transfer has assured transmission delay time and 
therefore is suited to transfer of input information from a 
keyboard or mouse. 

Bulk (isochronous) transfer is suited to transfer zIztq* 
quantity ol data at irregular intervals but transfer speed is go t 
Assure d. 

Control transfer is used for configuration of a USB device 
and to send and receive messages. When a device is con- 
nected to the USB, the device is configured to the host, the 
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end point is set and the pipe is assured to make possible the In the high-resolution still-imapp ^pdp^ hp. microproces- 

transfer of data. All data transfer is performed by the sor 27 sends a control signal to the parallel-plate drive circuit 

initiative of the host. In the example and structure shown in 16 to drive the parallel plate 15. The parallel plate 15 is 

FIG. 4, the USB device layer and the function layer perform arranged as shown in FIG. 5, by way of example, 

logical communication, whereby communication between s Specifically, two parallel plates of glass are so arranged as 

the host and the function of a physical device can be carried to tum about rcspcc tive horizontal and vertical axes of 

out. In the function layer, a plurality of logical pipes are rotation. Controlling the angle of rotation makes it possible 

handled, whereby data communication becomes possible to dispkcc thc optical path Tfae Qptical path ^ dispkccd by 

between the host and function refraction when light impinges upon the parallel plate at a 

The general operation of the desktop videoconference 1Q fixed angk of incidence . m amouat of disp i acem ent is a 

fiYStfiniWlllnowbedes^rjhe xl. ; ; of ^ thickness of the lass and me a le of 

Described first will be operation from image sensing incidence ( ang le of rotation), 

transfer tn the Y^ftt personal comput er 8 m a movin g-ima ge ^ . . 

nmdBJ n a case^ere Tine moving^i mage morfsTjln the basis of a control signal from the microprocessor 

sel^aa S ^eeatmLpanel 4. kevb ' bWlU or mouseTl ! 27 > the parallel-plate drive circuit 16 generates a driving 

The image sensed by the lens unit 13 is formed on the CCD 15 waveform of the kind shown m FIG. 7. Specifically, the 

17 via the parallel plate 15. In the case of the moving-image parallel-plate drive circuit 16 generates control waveforms 

mode, the parallel plate 15 is not driven by the parallel-plate mat shift pixels in the X (horizontal) direction and Y 

drive circuit 16. The CCD 17 converts the optical image to (vertical) direction every frame [where one frame comprises 

an electric signal a nd outputs the same in conlormijy jg5lh two vertical synchronizing signals (V)] in synchronism with 

, th^ tjp"' n g c thjr HvrrtHg g^T1frP trtr anfi ftvnr.hrnniyinp 20 the vertical synchronizing signal (V) from the synchronizing 

signal generator 19. The output CCD signal is adjusted by signal generator 19, 

the combined correlated double sampling circuit and auto- On the basis of the control waveforms, the parallel-plate 
matic gain control circuit 20. The CCD signal thus adjusted drive circuit 16, for example, is driven to actually shift the 
is supplied to the A/D converter 21, where it is converted to optical patn by a p rescribed amount. In this embodiment, it 
^jJigUajj mfigr w i rjn»1 T he digital image signal is subjected is ^ assumed that the amount by which the optical path is 
to prescribed color processing and white-balance adjustment shifted fc me of Qne M of ^ CCD 1? afld ^ ^ 
by the camera process circuit 22 m digital fashion and is then icd h ^ b . j k cach f ^ horizontal 
output as Y and U/V signals, which are digital video signals r , 4 . A^. . . 0 . 
that have been adjusted to the proper kvel. The camera or ve f cal dl 'f^ 0 ° (®^©)» as shown rn FIG. 8 in 
process circuit 22 extracts an AE signal and sharpness signal 30 fccordance with the driving waveforms of FIG. 7. This shall 
necessary to drive the lens unit 13 and outputs these signals be r<t ^J° ■? a °° e ;P, lx . el sluf *- ^ a resul . t of * e 
to the microprocessor 27. The latter drives the lens-unit one-pixel shift, the CCD 17 is capable of generating still- 
drive circuit 14 to perform focusing by adjusting the aper- ma 8 e Vlde0 data corresponding to the three colors R, G, B 
ture and driving the lens by hill-climbing control. m a P eriod ? f $2* frame^Movement ofthe pixel position 
The digital video signal output by the camera process 3S a ' l«™ * C^©-®®-© or ®-©®-© in 
circuit 22 is applied to the video process circuit 23 to be FIG^S. In regard to each pixel position, it ^possible to pick 
subjected to image-data compression processing and the like U P data of <** other two colors lost ln olAm ^ ma S e 
for purpose of communication. Here the communication sensing. 

compression scheme used is that for compressing moving 71,6 four-frame still-image CCD data arrives frame by 

images in videoconferencing. The scheme is typified by 40 &ame at the A/D converter 21 through a path similar to that 

H261 of ITU-T, by way of example. traversed in the moving-image mode and is converted to a 

Besides being subjected to the above-mentioned compres- di S ital si S nal in the manner described above. Tfte diptaU^. 

sion processing, it is also possible to apply the digital video converted stiU-i mage CCD data is sent to the memory . 

signal to the USB controller 35 for tr ansfer in th e tormaToT controller 'Ah . V d me oasis ot a color array ot inc long snown 

Y U/V to the host computer system «. The compressed data 4 , m FIG ' 9 ' the memorv controller 26 rearranges the video 

or the digital video signal in the V, U/V format is supplied datl > wmch 18 obtained in the order illustrated on the left side 

to the graphics card 39 via the USB controller 36 on the side of FIG - 10 > m the memorv 25 m me manner shown at the 

of the host personal computer 8 through the USB cable 7 . C6nter of FIG - 10 Fu ^ her ' b y memory-mapping the color 

whereby an image is displayed on the monitor. Transfer 2 5 data of "» encircled pixel positions on the left side of FIG. 

nf mnvina in,.^ ,,«ino th« lis p win h B H^ rrih^Tdetlji 5Q 10 in the manner shown on the right side, an image having 



latfci^ 



four times the size of an image sensed by the ordinary Bayer 



~ ., , t .„ . ~ . . method is produced. (Image quality is increase d by a factor 

Described next will be operation from image sensing to ^ \ fr — ^ 

transfer to the host personal computer H in a hj ^-resolution ^ — — ^ . 

still-imaae mode in a case where the high^^solution ItuT- The high-resolu tion still-image v ideo data thus rearranged 

rr^T^ h, g h^.n ^i ;^ ^^ ^^T^a 55 aniUUQje^^ k ima^e at aTtmr 

keyboard 10 or mouse 11. The image sensed by the lens unit via^te-mefflagutt^^ predetermined timing. The 

13 is formed on the CCD 17 via the parallel plates 15. The dala * transmitted to the host personal computer 8 via the 

parallel plater i< *~ *ri Yrv ; n cy ^chronism with a vertica 7 camcra P rocess circuit 22 » Vlde0 process circuit 23 andUgfl 

_a>'nrhrftnr^ n ^ , ^' , " n1 Q ; cvMr) fmm t he synchro nizing controller 35. 

signal generator 19. The CCD 17 converts itic oolical imttee 60 ^Control operation in the irnape sensinyy m nr lp ™p USft 

* to an electric signal and outputs the same in conformity with transfer mode, wnlch are the principal characterizing fea- 

the timings of the timing generator 18 and synchronizing lures of this embodiment, will now be described in detail, 

signal generator 19. The output CCD signal is converted to Transfer relating to local image sensing will be described 

a digital signal by the A/D converter 21. first. FIG. 11 is a flowchart illustrating operation of this 

The method of driving the parallel plates in the high- 65 system. The steps of the flowchart will be described, 

resolution still -image mode and the control of memory will First, at step SI, the application in the hard disk drive 38 

now be described. issues an image sensing instruction in response to an indi- 
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cation from the control panel 4 of the visualizer 1 or from the 
keyboard 10 or mouse 11 of the host personal computer 8. 
As a result, the visualizer 1 starts the sensing of moving 
images in the moving-image mode desc^V ^ RI irllfj 

Next, at step S2, the microprocessor 27 instructs isochr 
jonous. tran sfer for moving-image transfer to the host per- 
sonal computer 8 in order for the image to be transierreTT to 
the host personal computer 8. (}n a case where the image 
sensing instruction has been issued by an application in the 
host personal computer 8, however, control is performed 
from the application within the host personal computer 8.) 
That is, at the time of configuration, the CPU of the host 
personal computer 8 controls the USB controller, produces 
the end point of the isochronous transfer and allocates 
bandwidth. 

This is followed by step S3, at which the microprocessor 
27 of the visualizer 1 performs control in such a manner that 
the digital Y, U/V signals representing the digital moving 
image are t ransmitted to the host personal computer 8 in_ 

fprp* ii nitg- 

It is sensed at step S4 whether a high-resolution still- 
image input instruction has been issued fyv t ft ft o,p prn< ^ r f r D m 
the control panel of the visualizer 1 qrJiom the application 

j\f thy, h n^* pfii^^ aJL computer 8. In a case where the 
high-resolution still-image mode described above has not 
been selected in this system, the visualizer 1 contjrflieft {n 
transfer moving images to \ h f { hr cf p^r^nM ^r nrmter 8. 

In a case where the high-resolution still-image mode 
described above has been selected in this system, the visu - 
alizer 1 starts inp utting the high-resolution still image at step, 

1 S5. n ils means thai the high-resolution still-image data in 
the high-resolution still -image mode is stored in the memory _ 
25 and that memory mapping is performed by the memory 



high-resolution still image is saved in the memory 25 and the 
image is re-transmitted at the occurrence of an error, the 
re-transmission of the entire image takes time and the 
performance of the memory 25 declines. When such an 
arrangement is compared with a case where the method of 
this embodiment is used, it is found that the present inven- 
tion provides much higher system performance. 

Second Embodiment 

In the first embodiment, what is primarily described is 
transfer of a local image to the host personal computer 8 and 
display of the image on the monitor of the host personal 
computer 8 in order for an operation to performed using an 
application or the like. 

In this embodiment, transfer of data from ^ visiiaTfzer 1 
to the host persona l computer 8 during a videoconference 
will be descri bed. 

The system configuration is the same as that of the system 
20 described in conjunction with FIGS. 1 and 2. During a 
videoconference, however, the image data processed by the 
camera process circuit 22 is subjected to compressing cod- 
ing such as in accordance with H261 by the video process 
circuit 23 and the compressed coded data is transmitted to 
the multiplexer/demultiplexer 24. Data obtained by audio 
compression such as in accordance with G723 of ITU-T 



25 



performed by the audio process circuit 3.4. and control da ta 
fro m the microprocessor are multiplexed and transferrecTto 
Jhe host personal c omputer 8 via |be yfifl cflnfrpj^ 3^, ^ 
this time me multiplexed data is demultiplexed and the 
compressed image data is decompressed and displayed on 
the monitor 9 of the host personal computer 8 by the 
application installed in advance. Now the demultiplexed 
audio datq is , discard^ frr ^ fi fke.of processing speed and 



^ auu mat mmimy Luayym^ u pv,iiuiiuv^ j u y mv m^vi y . audio data is , discarde d frf r thp fiF iiS-Ot processing speed and 
controller 26. At almost tne same time thai me high- 3S audio quality j i.e., in order to eliminate the echo effects). 



resolution still image is input at step S5, the microprocessor 
27 controls the USB controller 35 on the side of the 
visualizer 1 at step S6 to send, b y interrupt transfer or the 
1ike 1 t|ie host personal computer request to perform bulk 
transfer. In res ponse, a pipe fo r bulk transfer is acquire d and* 
the transier oi gaiais 1 mdtiy possible 



The visualizer 1 tra nsmits the hi gh-resolution still imag e 

nryatftfi af strip ^ Jn t hp. hrW JSrreonTT^ornput er 8 at Step S7. 

Next, at step S8, it is determined whether the transfer of 
the high-resolution still image has ended. If the host personal 45 
computer 8 senses that the transfer has ended, the host 
personal computer 8 decides at step S9 whether the system 
should continue image sensing in the moving-image mode. 
If the decision is "YES", control returns to step SI. If the 
decision is "NO", then operation of the system is halted, 50 

In the embodiment described above, the signal processor 
of the CCD 17 is integrated with the camera proper and an 
easy-to-use USB interface is employed. This makes it pos- 
sible to eliminate the troublesome task of installing an 
expansion board as by removing the cover of the host ss 
personal computer 8, which is required in the prior art. 

Further, it is so arranged that moving and still images can 
be handled in the optimum transfer mode in terms or a USB 



The control command is interpreted by the CPU of the host 
personal computer 8 and used by the application. 
Meanwhile, the same multiplexed data is sent to the com- 
munications board 37 via the PCI bus by control performed 
40 by the microprocessor of the host personal computer 8, and 
jhfi ffota j^Jj^ &n ^^^i^^^^^^™^ 3 ^ °^ ^ e cornmu ~ 

USB control of the system at this time will now be 
described using the flowchart shown in FIG. 12. 

At step Sll in FIG. 12, the system transmits moving - 
image data from the visualizer 1 to the host-personal 
" computer 8 bvlsochronous tr an * f fi r fl uxing moving- image 
transfer or video f-nn fere rip , 

Next, if a high-resolution still image is sensed at step S12, 
input of the high-resolution still image is executed at step 
S13. 

This is followed by step S14, at which it is determined 
whether a videoconference is in progress. This information 
is a control command or the like from the host personal 
computer 8 and can be obtained by the visualizer 1 in 
advance. 

_If it is sensed at step S14 that a videoconference is in 
pr ogress, the Ubb transier mode is not changed over. Next 7 
at step S15. the visualizer 1 transmits the still-ima ge data 
captured at step S13 to the host person ai computer y;by 



. or lfchh 13^4 interface,. As a result^ in an lmaflt? KeilKlUg , 

a pparatus capable of sensin g moving and still images, it is 60 

possible to avoid loss oi' data <^ at n ^p^irs in a case where^a ~«r» — r w — — — i— — - y-j 

still image is trans ferred during transfer of a moving image -isochronou s transfer upon being c ompressed and multi- 
57 a tUiwlu uiUUc Uul does not guarantee data, thereby Wltn nt *m riflta \& the camer a process circuit ?2 ,' 

making it unnecessary to enter the still image again. Such video process circuit 23 and multiplexer/demultiplexer 24. 

re-entry of the still image data is time consuming because it 65 If il is determined at step S14 that a videoconference is not 
involves sensing, storing and memory mapping of a plurality in progress, a pipe is acquired by instructing the host 
of frames. Even if an arrangement is adopted in which a personal computer 8 \o makq a chan geover to *frp hulfr 



05/26/2004, EAST Version: 1.4.1 



US 6,583,809 Bl 



13 



14 



trans fer mode at step SI 6 in a manner similar to that of the 
n*rBT - embocUment. transmission is then performed. The 
processing of steps S17 to S21 is as described above in 
connection with the first embodiment. 

Though the visualizer 1 is provided with the multiplexer/ 
demultiplexer 24 in the foregoing embodiments, it is pos- 
sible to execute the same processing by the application in the 
host personal computer 8. In such case various data would 
be transferred to the host personal computer 8 after being 
subjected only to compression. 

In accordance with the second embodiment >v as^gaccib©^ 
afvwp. , it is sn arranged that bulk transfer is not used during 
a videoconfere nce,lh"ereby making it possible to prevent the 
^oss ot image - aata transterred to the communicating partyT 

In the foregoing embodiments, isochronous transfer is 
performed when moving image data is transterred and bulk 
t ransfer (ox^mclirj^qus transfer) k r^i^ put when^smi 
ir fl flpe is t ransiejifid. However, this does not impose a 
limitation upon the present invention. What is essential is 
that the invention include use of isochronous transfer when 
a low- resolution image for preview purposes is transferred 
and bulk transfer (or asynchronous transfer) when a high- 
resolution image is transferred. 

In other words, in a case where a low-resolution image for 
preview (which image is not limited to a moving image but 
may be low-resolution still image) is transferred, isochro- 
nous transfer is employed. Though the image is coarse, it can 
be previewed reliably in a short time. Even if a high- 
resolution image (which is not limited to a still image but 
may be a high-resolution moving image, e.g., a low frame- 
rate moving image formed by shifting pixels) flickers, a 
high-quality image can be transferred reliably. 

iLgoes without saying that the pres^ invqritipn not 
limited to isochronous transfer and bulk transfer 



10 



a CPU or MPU) of the system or apparatus from the storage 
medium, and then executing the program codes. 

In this case, the program codes read from the storage 
medium implement the novel functions of the invention, and 
the storage medium storing the program codes constitutes 
the invention. 

Further, the storage medium, such as a floppy disk, hard 
disk, optical disk, magneto-optical disk, CD-ROM, CD-R, 
magnetic tape, non -volatile type memory card or ROM can 
be used to provide the program codes. 

Furthermore, besides the case where the aforesaid func- 
tions according to the embodiments are implemented by 
executing the program codes rea d by a computer, it goe s 
without saying that the present invention covers a cas e 
.where an opeTarrnsr system jmne like running on the 



20 



25 



30 



35 



using a USB but is ai 



Jo isochronous transfer and_bujk^transfer (asynchrono us 
Transfer) using an 1394 bus . 

Further, it goes without saying that the present invention „^„„ tlllvJ a ^ ^ ^ t 

is applicable also to a digital cam corder, a digital still « ™ ol^m^^esenrinventiol 



computer performs a part of or the entire process in accor- 
dance witff me nesi f nati on n\ t . fl rftpry n, coaes and impl e- 
ments the functions according to the embodimen ts. 

It goes without saying that the present invention further 
covers a case where, after the program codes read from the 
storage medium are written in a function extension board 
inserted into the computer or in a memory provided in a 
function extension unit connected to the computer, a CPU or 
the like contained in the function extension board or func- 
tion extension unit performs a part of or the entire process 
in accordance with the designation of program codes and 
implements the function of the above embodiment. 

Thus, in accordance with the present invention, as 
described above, it is possible to avoid loss of data that 
occurs in a case where a high-resolution image is transferred 
during transfer of a low-resolution image in a periodic 
transfer mode that does not guarantee data, and it is unnec- 
essary to enter the high-resolution image again. Such 
re-entry of the high-resolution image is time consuming 
because it involves sensing, storing and memory mapping of 
a plurality of frames. Further, since isochronous transfer is 
used in regard to low-resolution data at all times without 
performing bulk transfer, a preview image can be checked 
quickly. 

The present invention is not limited to the above embodi- 
ments and various changes and modifications can be made 



camera and a camera for videoconferencing. 

JQie present invention further covers a scanner in which a 
coarse^pre-scanned syii image lor prq vifiw is transrerred 
isochronously and a high-resolution still image for actuaT 
usejs_sejit to a host computer by bulk (or asynchronous) 
transfer. 

In the foregoing embodiments, pixels are shifted when a 
high-resolution image is formed or transferred. It goes 
without saying that the shifting of pixels is not limited to 
shift by an amount equivalent to one pixel pitch as in the 
foregoing embodiments; a high -resolution image may be 
formed by a shift equivalent to half a pixel. 

Further, though the optical image is displaced periodically 
as the method of shifting pixels, it goes without saying that 
the image sensing device may be displaced instead. 

In a case where the number of pixels of the image sensing 
device is 1,000,000 or more for a high-resolution image and 
a low-resolution image is transferred, the image information 
may be reduced by downsampling or adding pixels. 

Other Embodiments 

It goes without saying that the objects of the present 
invention may be attained hv supplying ^ s^pf mfirijyp 
stnrjpp the, program codesof the software for performing the 65 
functions of the foregoing embodiments to a system or an 
apparatus, reading the program codes wun a computer (e.g., 
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Therefore, to apprise the public of the scope of the present 
invention, the following claims are made. 
What is claimed is: 

1. An image input apparatus comprising: 

image signal generating means for sensing the image of a 

subject and generating an image signal indicative 

thereof; 

data transfer means for transferring the image signal 
generated by said image signal generating means to an 
external device via a prescribed communications 
interface, said data transfer means having a first transfer 
mode in which there can be assured a fixed transfer rate 
but with no guarantee of data, and a second transfer 
mode in which data is guaranteed but transfer rate is 
not; and 

control means for controlling said data transfer means so 
as to perform image transfer in the first transfer mode 
in a case where said image signal generating means 
generates a low- resolution image signal and in the 
second transfer mode in a case where said image signal 
generating means generates a high-resolution image 
signal, 

wherein sensing of the high- resolution image is per- 
formed by synthesis of a plurality of images by shifting 
of pixels performed by said image signal generating 
means. 
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2. An image input apparatus comprising: 

image signal generating means for sensing the image of a 
subject and generating an image signal indicative 
thereof; 

data transfer means for transferring the image signal 
generated by said image signal generating means to an 
external device via a prescribed communications 
interface, said data transfer means having a first transfer 
mode in which there can be assured a fixed transfer rate 
but with no guarantee of data, and a second transfer 
mode in which data is guaranteed but transfer rate is 
not; 

control means for controlling said data transfer means so 
as to perform image transfer in the first transfer mode 
in a case where said image signal generating means 
generates a low-resolution image signal and in the 
second transfer mode in a case where said image signal 
generating means generates a high-resolution image 
signal; and 

sensing means for sensing a high-resolution image input 
instruction from an operator, 

wherein in a case where said sensing means senses the 
high-resolution image input instruction generated dur- 
ing low-resolution image data transfer by said data 
transfer means in the first transfer mode, said control 
means performs control so as to cause said image signal 
generating means to generate a high-resolution image 
and performs control so as to change over the transfer 
mode, and 

wherein sensing of the high-resolution image is per- 
formed by synthesis of a plurality of images by shifting 
of pixels performed by said image signal generating 
means. 

3, A method for inputting an image and transferring the 
image to an external device, comprising: 

an image signal generating step of sensing the image of a 
subject and generating an image signal indicative 
thereof; and 

an image transfer step of transferring the image signal 
generated at said image signal generating step to the 
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external device via a prescribed communications 
interface, wherein said image transfer step performs 
image transfer in a first transfer mode, in which there 
can be assured a fixed transfer rate but with no guar- 
antee of data, in a case where a low-resolution image 
signal is generated at said image signal generating step, 
and in a second transfer mode, in which data is guar- 
anteed but transfer rate is not, in a case where a 
high-resolution image signal is generated at said image 
signal generating step, 
wherein sensing of the high-resolution image is per- 
formed by synthesis of a plurality of images by shifting 
pixels. 

4. A method for inputting an image and transferring the 
image to an external device, comprising: 

an image signal generating step of sensing the image of a 

subject and generating an image signal indicative 

thereof; 

an image transfer step of transferring the image signal 
generated at said image signal generating step to the 
external device via a prescribed communications 
interface, wherein said image transfer step performs 
image transfer in a first transfer mode, in which there 
can be assured a fixed transfer rate but with no guar- 
antee of data, in a case where a low-resolution image 
signal is generated at said image signal generating step, 
and in a second transfer mode, in which data is guar- 
anteed but transfer rate is not, in a case where a 
high-resolution image signal is generated at said image 
signal generating step; and 

a changeover step of generating a high-resolution image 
signal and changing over the transfer mode to the 
second transfer mode in a case where an operator issues 
a high-resolution image input instruction during low- 
resolution image data transfer in the first transfer mode, 

wherein sensing of the high-resolution image is per- 
formed by synthesis of a plurality of images by shifting 
pixels. 
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